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UPDATING  THE  PRODUCT  FORM  OF  THE  INVERSE 


FOR  THE  REVISED  SIMPLEX  METHOD 


A  method  by  which  the  number  of  transformation 
matrices  in  the  product  form  of  the  inverse  for 
the  revised  simplex  method  of  solution  of  linear 
programs  need  never  exceed  m  , the  number  of  rows* 

Computer  codes  for  solving  linear  programs  by  the  simplex  method 
usually  use  one  of  three  forms  in  representing  the  problem  during  the 
course  of  solution.  These  are  (a)  the  standard  form  or  original  simplex 
method,  (b)  the  revised  simplex  method  with  explicit  Inverse;  and  (c) 
the  revised  simplex  method  with  Inverse  in  product  form  (ref.  l).  [For 
a  comparison  of  the  relative  efficlences  of  the  three  methods,  see  ref. 

2  ]  It  is  hoped  that  the  method  to  be  proposed  will  at  least  partially 
alleviate  one  of  the  principal  disadvantages  of  (c),  the  product  form 
algorithm,  namely  the  need  for  frequent  re-inversion  of  the  basis  in 
order  to  reduce  the  number  of  transformations,  without  sacrificing  too 
much  cf  some  of  its  advantages,  such  as  tb.e  sparseness  of  the  inverse 
and  the  ease  with  which  the  Inverse  is  kept  current.  The  chief  advantage 
of  this  proposal  is  that  the  number  of  non -zeros  in  the  inverse  repres¬ 
entation  is  conserved  and  remains  approximately  constant  after  the 
Initial  build  up 

The  product  fora  of  an  inverse  with  which  we  are  concerned  here  is 
the  indicated  product  of  a  number  of  elementary  m  x  m  transformation 
matrices,  each  such  matrix  being  an  identity  matrix  with  the  exception 
cf  one  column,  the  sc -called  transformation  column.  Computer  codes 


* 


using  the  product  form  of  the  inverse  need  to  store  only  these  except¬ 
ional  columns  and  their  column  indices  (usually  only  the  non-zero 
elements  of  these  columns  and  their  row  positions  are  stored). 

The  normal  procedure  is  to  adjoin  an  additional  elementary  matrix 
to  this  product  every  simplex  iteration  until  such  time  as  their  number 
becomes  too  large  for  efficiency  or  the  limit  of  storage  capacity  is 
reached;  at  which  time  the  current  basis  matrix  is  re-inverted  and 
k  ,  k  ^  m  ,  new  transformation  matrices  are  formed.  For  our  purposes, 
the  inverse  of  the  basis  B  is  represented  by  the  product  of  k 
elementary  transformation  matrices  : 


T 
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Let  us  assume  that  these  k  transformation  matrices  T^,  T^,..., 

correspond  to  columns  Q^,  Q^,...,  which  have  replaced,  in  turn, 

each  of  the  unit  vectors  U  ,  U  . . .  ,  U,  in  the  initial  unit  basis. 

*1  n2  \ 

For  the  purpose  of  exposition,  only,  suppose  that  the  rows  have  been 
reordered  so  that  h  =  t  (of  course,  this  is  not  necessary  in  practice) 
call  U,  =>  V  .  The  representation  of  an  outgoing  column  V  in  terms 

il  L  X 

X* 

of  a  basis  CL  ,  Q„, . . . ,  CL  Q  V  V  yields  the  usual  system 

12  t-l  t  1+1  m 

of  product  form  relations  : 


Vt  '  Tl,t\  +  +  Tt+l,tVt+X+"-  +  Tm,tVB 


where  t  ?  0  ,  t=l,2,...,k  . 


If, on  the  other  hand,  we  denote  oy  a.  the  coefficients  resulting 
when  relation  (l )  is  solved  for  ,  that  is: 
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a 


,  i  t  t 


=  -T  /t 

i,t  i,t'  t,c 

°t,t  - 

we  have  an  alternative  way  to  express  the  system  of  product  form 
relations : 


(2) 


where 


Q  a  Q  +  a  Q  +. . .  +  a  v  +  a  v  „+...+  a  1 

t  l,t  1  2,t  2  t,t  t  t+l,t  t+1  m,t 

Qt  t  ^  °  ••  »k  • 


m 


Relation  (2),  which  is  the  one  we  use  in  this  paper,  is  the  representation 
of  an  in-going  column  in  terms  cf  ohe  basis  0^,0^  ...  ,Q^  ^ V  , V  ..  .  .  , V^. 

Now,  suppose  that  a  new  vector  Is  c^osen  to  enter  the  basis. 

If  it  were  to  replace  one  of  the  unit  vectors  still  in  the  basis,  we 
will  adjoin  the  transformation  to  product  form  (2)  in  the  usual  way. 

We  will  not  concern  ourselves  further  with  this  case.  If,  however,  it 


were  to  replace 

% 

,  then 

S  ”  “l,i 

1 - 1 

> 

+  a 

2,1 

%  =  “l,2 

S. 

+  a2,2 

a,  V  +.  .  +  a  v 

k,l  k  m,l  m 


Vrt  +.  .  +  Q  0  V  +  . .  + 

Vr  a: 

(5)  ai,A  *a2,r%  +--+ar. 


_  v  +. .  +  a  v 

2  r,2  r  k,2  k  m,2  m 


r,l  r  ’ 

v,  +. .  +  a  v 

k  m,2  i 

v,  +. .  +  a  v 

k  m,r-l 

+,,  +  °k  r  \  +. .  +  a  V 


■r-l  -l,r-A  ,a2,r-lQS+'-+Qr,r-1Vr+--+ak,r-l'l(  m 


V 

, r  'r 


m,r  m 


Q  .  -  a  .  Q+  ct  .  Q-.  +. .  +  a  ,  Q  +. .  +  Q.  v  +. .  +  a.  ,v 

.  r+l  l,rtll  2,r+l^  r,r+l  r  x,r+l  - 


m, r+l  m 


k 

\  +\kQ2  +"+ar,kllr  +-'+Qr,kQr 

\+l=  ^.k+A  *  a2,k+lS  +"+  °r,k+]A  +’'+  “k.k+A  +"+  Q  '  'V 

where  a  ^  0  for  t-l,2,...,k  by  (2). 
t ,  x 
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m,k+l  m 
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Our  objective  ie  to  eliminate  Q  using  only  a  small  amount  of  additional 

r 

working  storage.  Relation  r  is  used  as  a  starting  "eliminator1  and 
relations  r+1,  r+2, . . . ,k+l  are  up-dated,  resulting  in  a  new  product 
form  with  Just  k  transformations,  as  shown  in  (4): 


<4 

=  a  v 

1 ,1  i 

+  cr  V  +. .  +  a  v 

2,1  2  r,l  r 

+  Qr+l,l  Vr+1  +-+  V 

?a 

.•=  a  o 

1,2  1 

+  Q  +  4.  Q  V 

2  2  2  r  2  r 

+  °r+l,2  Vr+1  +"'''  °k,2 

Sr+l"  °i, A  +--+ar,rCr  +ar+l,rFr+l  +--+ak,r  k 


Vl=  ai,r-A  +  “2,r-l®2  +' ' +  ar,r-lVr  +  “rd.r-l’rri*-'  “k ,  r-l  V’ ' + 

Cr  +ar+l,rPr+l  +‘ '  +  “k.r  \  ' + 

JW*  V+l\  +  a2,r+lQ2  +"+  °r,r+l^r+iT  °r+l,r+lCr+l+*  *  +  °k,r+lV--  + 
\+l°  “i, A  +aS,k%  +-‘+  “r,kQr*l  +  Qr+l,k\+2  +''+ak,kCk  + 


.  .  + 


a 

,v 

m, 

1  m 

Q 

V 

m, 

2  m 

a 

.  V 

m, 

r-1  m 

a' 

V 

m, 

r  m 

a' 

,  V 

m, 

r+1  m 

a' 

,  V 

m, 

k  m 

where  a'  ^  0  for  t=r,...,k  and  for  t  >  r  either  (G  ,  F  )  is 
t,t  t’  t+1 

the  same  as  (F^,  V  )  or  (V  F__ }  ,  where  F  is  the  same  as  V  . 

t  t+1  t+1'  t  r  r 

Before  giving  a  description  of  the  algorithm,  which  is  oriented  towards 

a  computer  code  adaptation,  it  might  be  informative  to  consider  an  example. 

It  will  be  helpful  here  to  assume  that  all  of  the  relations  involved 

are  expressed  in  the  form  of  (2).  For  the  sake  of  some  generality, 

however,  we  will  not  reorder  the  rows.  Therefore,  the  unit  vectors  will 

be  the  U  and  the  pivot  positions  will  not  necessarily  be  on  the 
ht 

diagonal.  We  will  indicate  the  pivots  by  underlining.  The  example  shows 
the  original  array,  a  "motion  picture"  of  the  step-by-step  procedure,  and 
finally  the  updated  array.  Each  step  consists  of  updating  a  relation  by 
the  application  of  an  eliminator,  and  then  forming  a  revised  eliminator 
to  be  used  on  the  next  step  by  the  use  of  the  updated  relation.  The 
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initial  eliminator  is  just  the  original  expression  for  .  An  updated, 
relation  is  allowed  to  pivot  either  on  the  same  index  position  as  that 
underlined  in  the  origina1  relation  or  the  position  underlined  in  the 
current  eliminator  (the  next  eliminator  will  always  have  its  underline 
in  the  alternative  position  to  the  one  chosen  for  pivot).  We  will  choose 
the  one  with  the  largest  coefficient  ir.  absolute  value,  making  an 
arbitrary  choice  in  case  of  ties. 


ORIGINAL  RELATIONS 


Step  1.  ELIMINATE 

UPDATED  =  -2U  -  2Ug  + 

ELIMINATE  U0  from  the  eliminator 


"T 
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Step  2 


Step  3. 


Step  4. 


FORM  2nd  ELIM 

S. 

S3  -U 

1 

■ 

OJ 

of 

V\ 

OLD: 

Q, 

=  U 

+ 

U  - 

3 

_1 

3  2 

ELIMINATE 

^  from  the 

eliminator 

UPDATED 

S 

e  U 
_1 

%  + 

U 

3 

ELIMINATE 

ur 

FORM  3rd  ELIM: 

“  -Q3  ' 

OLD: 

■  s  ■ 

V 

VS 

ELIMINATE 

from  the 

eliminator 

UPDATED 

-  2Q^  + 

V 

J>  '  \ 

ELIMINATE  U  : 

3 


FORM  4th  ELIM: 

\  ■  'S  -  2Q2 

OLD: 

S "  S 

+  Qa 

ELIMINATE 


from  the  eliminator 


0. 


5 


UPDATED 


UPDATED  RELATIONS 


This  algorithm  is  ons  of  several  possible  variants  for  updating  the 
transformations.  This  one  happens  to  proceed  through  the  transformations 
in  a  forward  direction.  Backward  working  algorithms  can  be  formulated 
along  very  similar  lines. 


Method 

Assume  that  in  addition  to  the  foregoing  k  transformations  a*'’ 
t-l,2,..,,k  ,  that  *:he  following  properly  ordered  aways  are  given: 


J 


=  column  name  associated  with  basic  variable  with  unit  coefficient 
on  row  i  of  the  canonical  form. 

-  current  -value  of  basic  variable. 

-•  storage  containing  the  entering  column  (called  J  )  expressed 
in  teane  of  the  current  basis. 

->  pivot  row  corresponding  to  the  t  transformation. 


The  following  arrays  are  available  for  working  storage: 

0:6^  =  for  updating  of  . 

E  ;  e  -  fcr  updating  eliminators. 

L  ;  f .  =»  for  -eccrding  new  pivot  positions  during  updating. 


The  following  one -cell  arrays  are  given: 


* 

j  =  name  of  column  entering  the  basic  set. 

t 

k  =  number  of  transformations  a 

/  .  St 

r  =  pivot  row  corresponding  to  the  (k+1)  transformation  F  . 

and  the  following  one-cell  arrays  are  available  for  working  storage : 

t  =  running  index  on  transformations. 

t 

p  =  pivot  position  of  the  updated  cr 
q  =»  alternate  pivot  position  not  selected  above. 

We  will  use  superscripts  with  arrays  D  and  E  to  differentiate  their 
contents  during  the  updating  steps. 


Initialization 


x 


(A) 

Trarsform  X 

.  r  , 

:  x  =  —  ;  x;  = 

Jr  r  °i 

xi  '  xi  fi  '  1  ^  r 

Ji  Jr 

(B) 

Replace  J^ 

by  new  column  name 

* 

J  . 

(c) 

L  :  L  =  i 

,  _  .  k+1 

;  if  none  store  a 

(D) 

Find  t  =»  s 

such  that  h  ,  ®  r 
s-1 

°i,k+l  fi 

with  h^  =  r  and 

go  to  (i) 

(E) 

_  _t  t 

Set  E  :  e 

= 

(F) 

Set  q  =  r 

where 


Algorithm 


(a)  If  t  =  k+1  go  to  (g)  otherwise  Form  ^ 


t  t 

6  =  Q  e 

q  r,t  q 


c  t  t 

and  6,  =  a  .  +  a  ej 
i  L^, o  r, t  i 
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for  i  f  q 


(L)  Choose  new  p  q  ;  new  q  =»  h  if  I  g1  I  >  I  8^  I  otherwise 

t  1  q  1  1  h^' 

new  p  -  h  and  q  remains  unchanged 

(c)  St  ere  updated  0^  ^  where  a  =»  6^  with  updated  h  =  p 

(d)  If  a.  p  go  to  (e);  otherwise  exchange  xl  with  x' 

t  nt  p 

J,  with  J 
ht  p 

,  ,  t+1  t+1  t  _t  t+1  t  t+1  _t 

le  Form  E  e  e  /&  ;  e  »  eJ  -  e  6.  ,  i  ?  p 

p  p  p  i  i  p  i 


(f)  Update  L  h  ,  increase  t  by  1  ,  go  to  (a) 

P  t 

(g)  Form  D  :  «  f  et  ;  6^  =  f  +  f  for  i  i  q 

q  r  q  i  r  i 

K.  t 

(h)  Store  updated  a  where  a  =  B  with  updated  h 

X  y  K  X  K 

(l)  Exit, 


Proof  that  there  is  always  at  least  one  non-zero  element 

This  algorithm  on  each  updating  step,  except  that  last,  makes  a 

choice  from  one  of  two  positions  for  the  pivot  location.  It  is  established 

below  that  ar  least  one  of  these  two  positions  has  a  non-zero  coefficient. 

Following  and  adding  to  the  notation  of  the  algorithm  described 
,  .  ,  .  th  th 

earlier,  denote  by  pit)  and  q(t)  the  p  and  q  position  choices 
,  th 

at  the  t  stage. 

Suppose  that  ’’.he  value  of  t  for  which  h  -  r  is  s  so  that 

1  ’"-l 

t  -  s  ,  s-l,...,krl  in  the  steps  of  the  algorithm.  Consider  any  value 
of  t  such  that  s  t  k  .  Let  us  make  the  inductive  assumption  that 

t 
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From  a) 


\  "V* 


+  a  e 

r.t  h. 


V 51  ° 


6q(t-l)  Qr,teq(t-l) 


If  a  =0  then  &  f  0  since  the  old  pivot  a  f  0  ;  if 
r ;  t  v  hr. 


ht,t 


a  ^  0  ,  then  5  .  .  f  0  by  our  inductive  assumption.  Hence  there 

r , t  q(t-l j 

exists  at  least  one  non-zero  pivot  choice.  We  need  also  to  show  e  f N  *  0 

q(t ) 

There  are  two  cases  to  consider: 


Case  1:  Suppose  q(t)  =  h^  and  p(t)  =  q(t-l)  implying  °r  t  ^  0  • 
The  elimination  of  q(t-l)  term  from  the  eliminator  yields  (see  Step  e) 

eq(t-l)(ah  ,t  +0r,teh  )  "Vt 


t+1  t 

Sq(t)  =  V 


+  0 


a 


r,teq(t-l ) 


a 


r,t 


Case  2:  Otherwise  p(t)  =  h^  and  q(t)  =  q(t-l)  implying  similarly 
cl  +  a  f  0  .  In  this  case  from  (e)  again 

v  r't  ht 


t+1  _  t 

eq(t)  eq(t-l) 


t  ^  t 
e  a  e  .  , 

ht  r,t  q(t-l) 


eq(t-l)aht,t 


°ht,t  +ar,t\  \,t+ar,t\ 


p  0 


To  complete  the  inductive  step  we  note  that  initially  for  t=s  , 

e‘J,  =  e°  f  0  hence  by  induction  etf .  f-  0  and  also  the  coefficient 
q(s-l)  r  q(t ) 

of  the  pivot  5  ,  \  f  0  for  t=s , s+1 , . . . ,  k  . 
p(t) 

Finally  at  step  k+1  the  pivot  index  is  q(k)  by  (g)  .  By 

definition  f  =  a  and  f  f  0  Thus,  from  our  inductive  hypothesis 

r  r,k+l  r 
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IV  T  _L.  iVTl  ,  _ 

fcq(k)  “  Qr,k+Ieq(k)  * 

so  that  the  final  pivot  coefficient  is  also  non-zero  completing  our 
proof. 

The  procedure  could  be  generalized  to  give  more  freedom  as  regards 
choice  of  pivot  at  the  expense  of  carrying  along  more  eliminators.  As 
noted  earlier,  it  is  possible  to  have  backward  elimination  aa  well  as 
forward. 
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